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© A display memory (15) for a display system (10, 
20) having a spatial light modulator (SLM) (16). The 
memory (15) receives data in pixel format and deliv- 
ers the data to the SLM (16) in bit-plane format. The 



memory (15) avoids the need for double buffering by 
reading out bit-planes that are comprised partly of 
data from one data from and partly of data from an 
adjacent data frame. 
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TECHNICAL FIELD OF THE INVENTION 

This invention relates to image display sys- 
tems, and more particularly to systems that pro- 
cess digital image data and use a spatial light 
modulator to display real-time images. 

BACKGROUND OF THE INVENTION 

Real-time display systems based on spatial 
light modulators (SLMs) are increasingly being 
used as an alternative to display systems using 
cathode ray tubes (CRTs). SLM systems .provide 
high resolution displays without the bulk 'and 'power 
consumption of a CRT system. _ -*j 
: Digital micromirror devices (DMDs) are a type 
of SLM, and may be used in projection display 
applications. A DMD has an array of micro-me- 
chanical pixel elements, each having a mirror and a 
memory cell. Each pixel element is individually 
addressable by electronic data. Depending on the 
state of its addressing signal, each mirror element 
is tilted so that it either does or does not reflect 
light to the image plane. Other SLMs operate on 
similar principles, with pixel elements that emit or 
reflect light simultaneously with other peel ele- 
ments, such that a complete image frame is gen- 
erated by addressing pixel elements rather than by 
scanning them. 

For processing data in an SLM-based systems, 
as is the case with other digital image processing 
systems, the processor operates on pixel data. 
Interlaced data is arranged pixel-by-pixel, row-by- 
row, and field-by-field. Scan conversion techniques 
are used to generate frames from fields. Non- 
interlaced data is already arranged as frames. Pro- 
cessing tasks such as colorspace conversion and 
scaling, as well as scan conversion, are performed 
on the pixel data. 

However, in an SLM-based system, the SLM 
must receive the data in "bit-planes". In other 
words, pixel data must be reformatted into bit-level 
data so that each peel element can be "on" or "off 1 
a length of time corresponding to the value of its 
pixel data. Various modulation schemes determine 
how long each pixel is on or off, and permit 
greyscale and color images to be displayed. A bit- 
plane represents all bits of all pixels having the 
same digital weight. For pixels having an n-bit 
resolution, there are n bit-planes per display frame. 

SLM-based systems use a "display memory" 
to provide bit-planes of data to the SLM. Existing 
display memories are "double buffered", so that 
they can store data for a current frame while data 
for a next frame is being written in. This permits 
each frame of data to be read out of memory and 
displayed on the SLM during its own frame period. 
Many display memories operating in this double- 



buffered mode require a capacity of two frames of 
data. A variation of double-buffering is dynamically 
allocating memory space so as to reduce the re- 
quired capacity. U.S. Patent Serial No. 07/755,883 
5 (Atty Dkt No. TI-16511), entitled "Dynamic Memory 
Allocation For Frame Buffer for Spatial Light 
Modulator", assigned to Texas Instruments Incor- 
porated, discusses these methods of using a dis- 
play memory. 

70 

SUMMARY OF THE INVENTION 

A first aspect of the invention is a display 
memory for use in a digital display system having 

-T5 a processor for performing image processing and 
having a. spatial light modulator (SLM) with bit- 
addressable pixel elements for generating an im- 
age. A first frame of samples of pixel data is written 
to the memory during a first frame period. This first 

20 frame is stored in the memory such that it may be 
read out in bit-planes comprised of one bit per 
sample. A second frame comprised of samples of 
pixel data is written to the memory during a second 
frame period, such that each sample of the second 

25 frame is written over the corresponding sample of 
the first frame. This second frame is also stored so 
that it may be read out in bit-planes comprised of 
one bit per sample. During either the first frame 
period or the second frame period, a bit-plane of 

30 data is read from the memory, with this reading 
step being performed with data from the first frame 
and data from the second frame. The reading step 
is repeated such that at least the same number of 
bit-planes as the number of bits representing each 

35 pixel are read out during a display period. Each of 
the bit-planes is delivered to the spatial light 
modulator for display. 

A technical advantage of the invention is that 
less memory capacity is required than for double- 

40 buffered memories. This reduces the cost of the 
system. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 Figures 1 and 2 are block diagrams of a SLM- 

based display system, having a display memory in 
accordance with the invention. 

Figure 3 illustrates a method of using a display 
memory in accordance with the invention, 
so Figure 4 illustrates how images are displayed 

from data of different data frames. 

Figure 5 illustrates a display memory. 

Figure 6 illustrates the formatter of Figure 5. 

Figure 7 illustrates the memory array of Figure 

55 5. 

Figure 8 illustrates the bit selector of Figure 5. 
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DETAILED DESCRIPTION OF THE INVENTION 

A comprehensive description of a DMD-based 
digital television system is set out in U.S. Patent 
No. 5,079,544, entitled "Standard Independent 
Digitized Video System* 1 , and in U.S. Patent Serial 

No. (Atty Dkt No. TI-17855), entitled 

"Digital Television System", both assigned to Tex- 
as Instruments Incorporated, and both incorporated 
herein by reference. 

U.S. Patent Serial No. 07/678,761, entitled 
"DMD Architecture and Timing for Use in a Pulse- 
Width Modulated Display System" (Atty Dkt No. Tl- 
15721), describes a method of formatting video 
data for use with a DMD-based display system and 
a method of modulating bit-planes to provide vary- 
ing pixel brightness. The general use of a DMD- 
based display system with a color wheel to provide 
sequential color images is described in U.S. Patent 
Serial No. 07/809,816, entitled "White Light En- 
hanced Color Field Sequential Projection" (Atty Dkt 
No. TI-16573). These patent applications are as- 
signed to Texas Instruments Incorporated, and in- 
corporated herein by reference. 

Figure 1 is a block diagram of a SLM-based 
projection display system 10, which provides color 
images from pixel data sampled from a video sig- 
nal. Although the following description is in terms 
of a receiver for a broadcast television signal, it 
should be understood that receiver 10 could be 
any type of equipment for receiving an analog 
composite video signal and displaying images re- 
presented by the signal. Figure 2 is a block dia- 
gram of a similar system 20, in which the image 
data input signal already represents digital data. In 
both Figures 1 and 2, only those components sig- 
nificant to pixel processing and bit-plane conver- 
sion are shown. Other components, such as those 
used for processing synchronization and audio sig- 
nals, are not shown. 

The invention, which involves various aspects 
of memory 15, is useful with either system 10 or 
20. For purposes of example, the description here- 
in is directed to system 10. 

An image having 640 pixels per row, 480 rows 
per frame, and 24 bits per pixel is assumed. This is 
after a de-interlacing process is performed by pro- 
cessor 14, to convert interlaced fields having 240 
odd-rows or even-rows into frames having 480 
rows. There are 8 bits of pixel data for each of 
three colors. Thus, there are 24 bit-planes. The 
primary effect of different frame and pixel sizes 
would be differences in the memory sizes de- 
scribed herein. 

As an overview of system 10, signal interface 
unit 11 receives an analog television signal and 
separates video, synchronization, and audio sig- 
nals. It delivers the video signal to A/D converter 



12a and Y/C separator 12b, which convert the 
signal into pixel-data samples and perform lumi- 
nance/chrominance separation. These A/D conver- 
sion and Y/C separation tasks could be performed 

5 in either order. 

A field buffer 13 is interposed between Y/C 
separator 12b and processor 14. This field buffer 
13 is useful for field spreading. Because the SLM- 
based system 10 does not require vertical blanking 

70 time, the extra time between fields may be used to 
increase the time available for processing data and 
for loading bit-planes to the SLM 16. Field buffer 
13 may have other functions related to color wheel 
synchronization and scaling. 

15 Processor system 14 prepares the data for 

display, by performing various processing tasks. 
Processor system 14 includes a processing mem- 
ory for storing pixel data during processing. 

Display memory 15 receives processed pixel 

20 data from processing system 14. As explained be- 
low in connection with Figures 3 - 8, display mem- 
ory 15 formats incoming data into bit-planes, which 
it delivers to SLM 16, one at a time. Memory 15 
need have only a capacity of one frame of data. 

25 SLM 16 may be any type of SLM. Although 

this description is in terms of a DMD-type SLM, 
other types of SLMs could be substituted into 
system 10 and used for the method described 
herein. For example, SLM 16 could be an LCD- 

30 type SLM. Details of a suitable DMD can be found 
in U.S. Patent No. 4,956,619, entitled "Spatial Light 
Modulator", which is incorporated by reference 
herein. 

Display unit 17 is essentially the optical com- 

35 ponents for receiving the image from DMD 16 and 
for illuminating an image plane such as a display 
screen. For color displays, the bit-planes for each 
color could be sequenced and synchronized to a 
color wheel that is part of display unit 17. Or, the 

40 data for different colors could be concurrently dis- 
played on three SLMs and combined by display 
unit 17. Master timing unit 18 provides various 
system control functions. 

Figures 3 and 4 illustrate a method of writing 

45 into and reading out of display memory 15, in 
accordance with the invention. Figures 3 and 4 are 
functional illustrations; an example of a structural 
embodiment of memory 15 is described below in 
connection with Figures 5-8. 

so More specifically, Figure 3 illustrates the spatial 

relationship between the writing of pixel-data sam- 
ples to memory 15 and the reading of bit-plane 
data out of memory 15. As explained below, data is 
stored in memory 15 in bit-level sections, where 

55 each section stores only data for one bit-level. The 
section illustrated in Figure 3 stores data for bit 0. 
For storing a frame of data, memory 15 has the 
same number of sections as bit-planes. 
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In the example of Figure 3, the 480 rows of bit 
0 data are stored in contiguous memory rows, Ri 
to FWso- However, the memory rows need not be 
contiguous so long as some sort of random access 
is available. 

Also, in the example of this description, the 
number of pixels displayed on SLM 16 is the same 
as the number of samples in a data frame. In other 
systems, each data frame stored in memory 15 
may have extra samples per row of pixel elements 
on SLM 16, or samples for extra rows, or both. The 
invention is the same in both cases, in that the 
capacity of memory 15 need be no more than the 
number of samples per data frame. 

Data samples are loaded to memory 15 in the 
temporal order in which they arrived. Using the 
sample for pixel 1 , row 1 , Frame N as a starting 
point, that data sample is loaded first. Each bit of 
pixel 1 is written to a different memory section so 
that the data can be accessed by bit-level. Then 
the data for pixel 2, row 1, Frame N, is written, 
followed by the data for pixel 3, row 1, etc, until all 
data of row 1, Frame N, are loaded. This process 
repeats for row 2, row 3, etc, until ail data samples 
of Frame N are loaded. 

After row 480 of frame N is written, the write 
process begins again with pixel 1, row 1, Frame 
N + 1 . As each new bit of data for Frame N + 1 is 
written, it overwrites the corresponding bit of Frame 
N. Because of this overwriting, in general, at any 
given time, memory 15 contains row 1 through row 
n of Frame N + 1 and row n + 1 through row 480 of 
Frame N. Of course, there may be a time between 
frames, when n = 480 or n = 0 and memory 15 
stores rows 1 through 480 of only one frame. 

Data is read out of memory 15 to SLM 16 in 
bit-planes, one bit from each pixel of all rows. The 
24 bit-planes may be read out in any order, de- 
pending on the particular modulation scheme being 
used. For example, the order could be first, the bit- 
plane for the most significant bit (MSB), then the 
bit-plane for the next most significant bit, etc, and 
last, the bit-plane for the least significant bit (LSB). 
For color images, which in the example of this 
description have 8 bits for each of three colors, 8 
bit-planes for each color represent bits 0 - 7 of 
each color. 

Because memory 1 5 stores data from two adja- 
cent data frames, Frame N and Frame N + 1, in 
general, a bit-plane contains data from both Frame 
N and from Frame N + 1. In other words, each of 
the 24 bit-planes that comprise an image to be 
displayed do not always have data from the same 
data frame. 

For real time displays, the rate at which SLM 
16 displays data must keep up with the rate of 
incoming data. For a system 10 having a field 
buffer 13 and "spread" data, the time available for 



writing a frame into memory and reading a frame 
out of memory is one field period, which for NTSC 
signal is 1/60 second (approximately 16.67 mil- 
lisecond). Likewise, the time available for reading 
5 data out of memory 15 is one field period. For de- 
interlaced data, the field period is the same as the 
frame period. If the data is not spread, the time 
available for writing and reading is slightly less. In 
any event, SLM 16 keeps up with incoming data by 
10 displaying each new image at a rate equal to the 
60 field per second frequency. Although the dis- 
play period for each image is the same as the field 
period (16.67 milliseconds), these periods do not, 
in general, begin or end in unison. 
15 Figure 4 illustrates how the data for each im- 

age is "skewed" with respect to the data frames, 
as a result of the reading out process described 
above. The jagged lines separating the data frames 
are referred to herein as "frame skew lines". The 
20 period of time between two frame skew lines is one 
frame period (approximately 16.7 milliseconds). 
Each row of data is displayed for a time equal to a 
frame period, but the display of different rows of 
the same data frame may begin and end at dif- 
25 ferent times. For example, for Frame N + 1 , the 
data for row 10 is displayed from ti to U, whereas 
the data for row 1 50 is displayed from t 3 to t 5 . 

The bit-planes read out from memory 15 are 
represented as vertical time slices. At any point on 
30 a frame skew line, the data above the line are from 
a next frame and the data below the line are from a 
current frame. The frame skew lines are jagged 
because of the different display times allocated for 
different bit-planes. In other words, each bit-plane 
35 is associated with one of eight different display 
times that vary according to bit level. The MSBs 
have the longest display time, the LSBs the shor- 
test. Where there are 24 bit-planes per frame, each 
frame skew line has 24 "jags". Each jag represents 
40 one bit-plane, which is in turn associated with one 
of the eight different bit-plane display times. In 
Figure 4, the display time of each bit-plane is one 
contiguous time slice, but other modulation 
schemes are possible. 
45 For example, time tO to t1 is allocated for the 

most significant bit of red data. During this time, all 
data being read out to SLM 16, and hence all data 
being displayed, is from frame N. As another ex- 
ample, time t2 to t3 is allocated for the most 
so significant bit of green data. During this time, rows 
1 through 130 are from Frame N + 1, whereas rows 
131 through 480 are from Frame N. 

The above-described method of using a dis- 
play memory 1 5 can be used with various memory 
55 implementations. These include variations in wheth- 
er the data is formatted by a separate formatting 
device, formatted on input with logic integrated with 
memory 15, or formatted on output with logic in- 
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tegrated with memory 15. Other variations involve 
partitioned memory space. Examples of display 
memories for an SLM-based display system are 
found in the following patent applications: U.S. Pat- 
ent Serial No. 07/755,981 (Atty Dkt No. TI-16510), 
entitled "Data Formatter with Orthogonal In- 
put/Output and Spatial Reordering"; U.S. Patent 
Serial No. 07/756,026 (Atty Dkt No. TI-16512), en- 
titled "Partitioned Frame Memory for Spatial Light 
Modulator"; and U.S. Patent Serial 

No. (Atty Dkt No. TI-17404), entitled 

"Digital Memory for Display System Using Spatial 
Light Modulator". Each of these patent applications 
is assigned to Texas Instruments Incorporated, and 
is incorporated by reference herein. 

Figure 5 illustrates one example of a display 
memory 15, with which the method of the invention 
may be used. Memory 15 is comprised essentially 
of a formatter 51, a memory array 52, a bit selector 
53, and a controller 54. 

As described above, one aspect of the present 
invention is the space and time relationship of the 
pixel data input to memory 15 and the bit-plane 
data output from memory 15. The method of the 
present invention eliminates the requirement that 
the data in a display image correspond to the data 
in a video frame. Although the each display image 
contains the same amount of data as a video 
frame, it does not necessary comprise data from 
only one frame. That is, a display image may 
contain data from two adjacent video signal frames. 
Because of this relationship, memory 15 need only 
have a capacity of one data frame. 

Figure 5 assumes a n on- partitioned memory, 
where memory 15 stores data for all rows. In a 
partitioned memory, memory 15 might store data 
for only the top or bottom half of SLM 16, and a 
second memory 15 would store data for the other 
half. The principles of the present invention would 
be the same for a partitioned memory, except that 
each partition would operate in parallel. 

Incoming pixel data is written to memory 15 
sample-by-sample, row-by-row, frame-by-frame. 
Thus, the incoming data is 24 bits wide. Formatter 
51 re-arranges this data into bit-level data. 

Figure 6 illustrates one embodiment of format- 
ter 51 . Each row of data (640 pixel samples) is 
divided into 40 blocks of 16 samples each (40 x 16 
= 640) Formatter 51 has 40 blocks, each having a 
block register 61. Each block register 61 receives 
one block of data. Because each sample is 24 bits, 
the capacity of each block register 61 is 384 bits 
(24 x 16 = 384). After the first block register 61 
has been filled with data for the first sixteen sam- 
ples, driver 54 addresses the next block register 
61 , which stores the data for the next sixteen 
samples. This process continues until each block 
register 61 has been filled with data for 16 sam- 



ples, and hence the 40 block registers 61 store the 
data for one row. 

A multiplexer 62 associated with each block 
register 61 receives the data from that block regis- 
5 ter 61. Each multiplexer 62 outputs its data, one bit 
at a time, to memory array 52. 

As illustrated in Figure 7, memory array 52 has 
40 columns, one column for each block register 61 
of formatter 51. Each column stores data for 16 

w pixels of 480 rows. Each column is further divided 
into bit-plane areas 71 , for storing bit levels of the 
16 pixels and 480 rows of that column. Each area 
71 stores 7680 bits (1 bit per pixel x 16 pixels per 
row x 480 rows = 7680 bits). Each column has 24 

15 areas 71, one for each bit-level. Across the 40 
columns of array 52, the 24 bit-planes that com- 
prise one image are stored. In Figure 3, the section 
of memory 15 illustrated in that figure for this 
embodiment of memory 15 is 40 sections 71 of 

20 array 52. 

Referring again to Figure 5, the data moves 
from array 52 into bit select unit 53 As compared 
to the data into formatter 51, the data into bit 
selector 53 arrives in bit-fevel order. 

25 Figure 8 illustrates bit selector 53 in further 

detail. Bit selector 53 has 40 columns, one asso- 
ciated with each column of array 52. Each column 
has a first shift register 81 , which receives 256 bits 
of data (1 bit x 16 pixels x 16 rows = 256 bits) 

30 from a bit-plane section 71 of array 52. These 256 
bits are of the same bit level but from different 
rows, such that across the 40 columns of bit selec- 
tor 53, the shift registers 81 store one level of bit- 
plane data for 16 rows. A second shift register 82 

35 in each column selects every 16th bit so that the 
data delivered to SLM 16 is in bit-planes, row-by- 
row. Each of the 40 columns delivers 1 bit at a 
time to SLM 16. 

Referring again to Figure 5, controller 54 pro- 

40 vides block addresses, row addresses, and bit- 
plane addresses for formatter 51, array 52, and bit 
selector 53, respectively. These addresses may be 
generated internally with counters, or provided ex- 
ternally by processor 14 or a timing unit. In the 

45 former case, memory 15 will be addressed in con- 
tiguous rows, whereas in the latter case, memory 
15 may be addressed row-randomly. Another func- 
tion of controller 54 is to resolve conflicts if access 
to the same data for reading and writing is at- 

50 tempted. This may be accomplished with tech- 
niques known in the art of memory management, 
especially for the case of dual ported memories. 

The memory described in connection with Fig- 
ures 5 - 8 is only one example of a display mem- 

55 ory with which the invention may be used. Other 
types of display memories may use other means 
for formatting the data into bit-planes. U.S. Patent 
Serial No. (Atty Dkt No. TI-17404) 
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(referred to above), describes a display memory 15 
that stores data in pixel format and has a means for 
re-formatting the data into bit-planes on output. 
Regardless of the implementation, the method of 
the present invention is the same in that a single- 5 
buffered memory delivers bit-planes of data that 
are comprised of data from two adjacent data 
frames. 

Other Embodiments 

Although the invention has been described with 
reference to specific embodiments, this description 
is not meant to be construed in a limiting sense. 
Various modifications of the disclosed embodi- 
ments, as well as alternative embodiments, will be 
apparent to persons skilled in the art It is, there- 
fore, contemplated that the appended claims will 
cover all modifications that fall within the true 
scope of the invention. 

Claims 

1. A method of using a memory for storing data 
for use in a display system having a processor 
for processing pixel data and having a spatial 
light modulator (SLM) for generating an image, 
comprising the steps of: 

writing a first frame of samples of pixel data to 
said memory during a first frame period; 
writing a second frame comprised of samples 
of pixel data to said memory during a second 
frame period, such that each sample of said 
second frame is written over the corresponding 
sample of said first frame; 35 
reading a bit-plane of data from said memory; 
repeating said reading step such that at least 
the same number of bit-planes as the number 
of bits representing each pixel intensity are 
read out during a display period; 40 
wherein one or more of the reading steps are 
performed with data from said first data frame 
and data from said second data frame; 
delivering each of said bit-planes to said spa- 
tial light modulator; 45 
wherein all of said steps are repeated to gen- 
erate a continuous display of images. 

2. The method of Claim 1, wherein said writing 
steps occur in contiguous rows of said mem- 50 
ory. 

3. The method of Claim 1, wherein said writing 
steps occur in randomly accessible rows of 

said memory. 55 

4. The method of Claim 1, wherein said memory 
is partitioned into multiple areas and said writ- 



ing and reading steps occurs in parallel for 
each partition of said memory. 

5. The method of Claim 1, wherein said writing 
step is performed with one or more input regis- 
ters, to which data is written in pixel format, 
and with a memory array, which receives bit- 
level data from said one or more input regis- 
ters. 



10. The method of Claim 1, wherein said reading 
step is performed once for each of said bit- 
planes. 

11. The method of Claim 1, wherein said reading 
step is performed more than once for one or 
more of said bit-planes. 

12. A display system for performing the method of 
any preceding claim. 



70 

6. The method of Claim 1, wherein said reading 
step is performed with two or more output 
registers, which receive bit- level data from a 
memory array and which select said bit-level 

15 data on a row-by-row basis. 

7. The method of Claim 1 , further comprising the 
step of using a memory controller to arbitrate 
conflicts between said writing steps and said 

20 reading step. 

8. The method of Claim 1, wherein one or more 
of the reading steps occurs during said first 
frame period, such that the bit-plane is com- 

25 prised of data from said first data frame. 

9. The method of Claim 1, wherein said reading 
step is repeated in the same bit-level order for 
each bit-plane. 

30 
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